Evaluation frameworks for speech translation technologies
نویسنده
چکیده
This paper reports on activities carried out under the European project PF-STAR and within the CSTAR consortium, which aim at evaluating speech translation technologies. In PFSTAR, speech translation baselines developed by the partners and off-the-shelf commercial systems will be compared systematically on several language pairs and application scenarios. In CSTAR, evaluation campaigns will be organized, on a regular basis, to compare research baselines developed by the members of the consortium. The first evaluation campaign, which will take place in 2003, will focus on written language translation by exploiting a large phrase-book parallel corpus covering several European and Asiatic languages.
منابع مشابه
Towards Innovative Evaluation Methodologies for Speech Translation
This paper reports on activities within the C-STAR1 consortium which aim at novel speech translation technologies and their evaluation. In C-STAR, current state-of-the-art speech translation systems developed by the partners are evaluated and discussed on a regular basis by means of evaluation workshops. The objectives of these workshops are to provide a framework for the validation of existing...
متن کاملOverview of the IWSLT04 evaluation campaign
This paper gives an overview of the evaluation campaign results of the IWSLT041 workshop, which is organized by the C-STAR2 consortium to investigate novel speech translation technologies and their evaluation. The objectives of this workshop is to provide a framework for the applicability validation of existing machine translation evaluation methodologies to evaluate speech translation technolo...
متن کاملQCRI Live Speech Translation System
We present QCRI’s Arabic-to-English speech translation system. It features modern web technologies to capture live audio, and broadcasts Arabic transcriptions and English translations simultaneously. Our Kaldi-based ASR system uses the Time Delay Neural Network architecture, while our Machine Translation (MT) system uses both phrase-based and neural frameworks. Although our neural MT system is ...
متن کاملReflecting on Backward Design for Knowledge Translation; Comment on “A Call for a Backward Design to Knowledge Translation”
In a recent Editorial for this journal, El-Jardali and Fadlallah proposed a new framework for Knowledge Translation (KT) in healthcare. Many such frameworks already exist; thus, new entrants to the field must be scrutinized in regard to their unique contributions to advancing understanding and practice. The El-Jardali and Fadlallah framework focuses on policy-level discussions, a relatively und...
متن کاملEvaluation of Automatic Speech Recognition and Speech Language Translation within TC-STAR: Results from the first evaluation campaign
This paper reports on the evaluation activities conducted in the first year of the TC-STAR project. The TC-STAR project, financed by the European Commission within the Sixth Framework Program, is envisaged as a long-term effort to advance research in the core technologies of Speech-to-Speech Translation (SST). SST technology is a combination of Automatic Speech Recognition (ASR), Spoken Languag...
متن کامل